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pLn ' This is a short introduction to the subject of strategic games. We focus on 

the concepts of best response, Nash equihbrium, strict and weak dominance, and 
mixed strategies, and study the relation between these concepts in the context of 
^ I the iterated elimination of strategies. Also, we discuss some variants of the original 

■ definition of a strategic game. Finally, we introduce the basics of mechanism design 

, and use pre-Bayesian games to explain it. 

1 Introduction 

> 

Q ■ Mathemat ical game theory, as launched by Von N eumann and Morgenstern in their sem 



, inal book, lyon Neumann and Morgenstern! 1944j . followed by Nash's contributions iNash 



1950l . I1951I ] has become a standard tool in economics for the study and description of 



p 

^ I various economic processes, including competition, cooperation, collusion, strategic be- 
haviour and bargaining. Since then it has also been successfully used in biology, political 
sciences, psychology and sociology. With the advent of the Internet game theory became 
increasingly relevant in computer science. 
^ ! One of the main areas in game theory are strategic games (sometimes also called 

I non-cooperative games), which form a simple model of interaction between profit 

maximising players. In strategic games each player has a payoff function that he aims to 
maximise and the value of this function depends on the decisions taken simultaneously 
by all players. Such a simple description is still amenable to various interpretations, 
depending on the assumptions about the existence of private information. The purpose 
of this primer is to provide a simple introduction to the most common concepts used 
in strategic games: best response, Nash equilibrium, dominated strategies and mixed 
strategies and to clarify the relation between these concepts. 

In the first part we consider the case of games with complete information. In the 
second part we discuss strategic games with incomplete information, by introducing first 
the basics of the theory of mechanism design that deals with ways of preventing strategic 
behaviour, i.e., manipulations aiming at maximising one's profit. We focus on the concepts, 
examples and results, and leave simple proofs as exercises. 



*Centruin for Mathematics and Computer Science (CWI), Science Park 123, 1098 XG Amsterdam, 
the Netherlands, and University of Amsterdam. 
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2 Basic concepts 



Assume a set {1, . . . , tt,} of players, where n > 1. A strategic game (or non-cooperative 
game) for n players, written as {Si, . . . , Sn,Pi, ■ ■ ■ ,Pn), consists of 

• a non-empty (possibly infinite) set Si of strategies , 

• a payoff function : S*! x . . . x S'„ — M, 

for each player i. 

We study strategic games under the following basic assumptions: 

• players choose their strategies simultaneously; subsequently each player receives a 
payoff from the resulting joint strategy, 

• each player is rational, which means that his objective is to maximise his payoff, 

• players have common knowledge of the game and of each others' rationality^ 

Here are three classic examples of strategic two-player games to which we shall return 
in a moment. We represent such games in the form of a bimatrix, the entries of which are 
the corresponding payoffs to the row and column players. 

Prisoner's Dilemma 



Battle of the Sexes 



C 
D 



F 
B 



c 


D 


2,2 


0,3 


3,0 


1,1 


F 


B 


2,1 


0,0 


0,0 


1,2 



Matching Pennies 








H 


T 


H 


1,-1 


-1, 1 


T 


-1, 1 


1,-1 



We introduce now some basic notions that will allow us to discuss and analyse strategic 
games in a meaningful way. Fix a strategic game 

{Si,...,Sn,Pl,...,Pn)- 

We denote Si x . . . x Sn^y S, call each element s G a joint strategy, or a strategy 
profile, denote the ith element of s by Si, and abbreviate the sequence {sj)j^i to 



^Intuitively, common knowledge of some fact means that everybody knows it, everybody knows that 
everybody knows it, etc. 
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Occasionally we write (sj, S-i) instead of s. Finally, we abbreviate Xj^iSj to S-i and use 
the notation for other sequences and Cartesian products. 

We call a strategy Sj of player i a best response to a joint strategy s_j of his opponents 

if 

Vs- G Si pi{si, S-i) > pi{s'i, S-i). 

Next, we call a joint strategy s a Nash equilibrium if each Si is a best response to 
s_j, that is, if 

\fi e {l,...,n} \fs[ e Si Pi{si,s_i) >Pi{s[,s^i). 

So a joint strategy is a Nash equilibrium if no player can achieve a higher payoff by 
unilaterally switching to another strategy. 

Finally, we call a joint strategy s Pareto efficient if for no joint strategy s' 

\/i e {1, . . . ,n} pi{s') > pi{s) and 3i e {1, . . . ,n} pi{s') > pi{s). 

That is, a joint strategy is Pareto efficient if no joint strategy is both a weakly better 
outcome for all players and a strictly better outcome for some player. 

Some games, like the Prisoner's Dilemma, have a unique Nash equilibrium, namely 
(D, D), while some other ones, like the Matching Pennies, have no Nash equilibrium. Yet 
other games, like the Battle of the Sexes, have multiple Nash equilibria, namely (F, F) 
and {B,B). One of the peculiarities of the Prisoner's Dilemma game is that its Nash 
equilibrium is the only outcome that is not Pareto efficient. 

Let us return now to our analysis of an arbitrary strategic game {Si, . . . , Sn, pi, . . . , Pn)- 
Let Si, s- be strategies of player i. We say that Sj strictly dominates s[ (or equivalently, 
that s- is strictly dominated by Si) if 

Vs_i e S-i pi{si, S-i) > pi{s'i, S-i), 

that Si weakly dominates s'^ (or equivalently, that s- is weakly dominated by Si) if 

\/s-i G S-i pi{si, S-i) > pi{s[, S-i) and 3s_i G S-i pi{si, S-i) > pi{s^, S-i), 
and that Si dominates s- (or equivalently, that s- is dominated by Si) if 

Vs_i G S-i pi{si, S-i) > pi{s'i, S-i). 

Further, we say that Si is strictly dominant if it strictly dominates all other strategies 
of player i and define analogously a weakly dominant and a dominant strategy. 

Clearly, a rational player will not choose a strictly dominated strategy. As an illustra- 
tion let us return to the Prisoner's Dilemma. In this game for each player, C (cooperate) 
is a strictly dominated strategy. So the assumption of players' rationality implies that 
each player will choose strategy D (defect). That is, we can predict that rational players 
will end up choosing the joint strategy {D, D) in spite of the fact that the Pareto efficient 
outcome (C, C) yields for each of them a strictly higher payoff. 

The Prisoner's Dilemma game can be easily generalised to n players as follows. Assume 
that each player has two strategies, C and D. Denote by C" the joint strategy in which 
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each strategy equals C and similarly with D". Further, given a joint strategy S-i of the 
opponents of player i denote by |s_j(C)| the number of C strategies in 

Assume now that ki and /j, where i G {1, . . . , n}, are real numbers such that for all 
i E {I, . . . ,n} we have ki{n — 1) > k > 0. We put 

{ki\s_i{C)\+k iisi = D 
\h\s_,iC)\ iis, = C. 

Note that for n = 2, k^ = 2 and /j = 1 we get the original Prisoner's Dilemma game. 

Then for all players i we have Pi{C^) = ki{n — 1) > U = pi{D^), so for all players the 
strategy profile C"" yields a strictly higher payoff than D". Yet for all players i strategy C 
is strictly dominated by strategy D, since for all s_j G S-i we have Pi{D, S-i)—pi{C, s_j) = 
k > 0. 

Whether a rational player will never choose a weakly dominated strategy is a more 
subtle issue that we shall not pursue here. 

By definition, no player achieves a higher payoff by switching from a dominant strategy 
to another strategy. This explains the following obvious observation. 

Note 2.1 (Dominant Strategy). Consider a strategic game G. Suppose that s is a joint 
strategy such that each Si is a dominant strategy. Then it is a Nash equilibrium of G. 

In particular, the conclusion of the lemma holds if each Si is a strictly or a weakly 
dominant strategy. In the former case, when the game is finite, we can additionally assert 
(see the lESDS Theorem 13.21 below) that s is a unique Nash equilibrium of G. This 
stronger claim does not hold if each Sj is a weakly dominant strategy. Indeed, consider 
the game 



L R 



1,1 


1,1 


1,1 


0,0 



Here T is a weakly dominant strategy for the player 1, L is a weakly dominant strategy 
for player 2 and, as prescribed by the above Note, (T, L), is a Nash equilibrium. However, 
this game has two other Nash equilibria, (T, R) and {B, L). 

The converse of the above Note of course is not true. Indeed, there are games in which 
no strategy is dominant, and yet they have a Nash equilibrium. An example is the Battle 
of the Sexes game that has two Nash equilibria, but no dominant strategy. 

So to find a Nash equilibrium (or Nash equilibria) of a game it does not suffice to 
check whether a dominant strategy exists. In what follows we investigate whether iterated 
elimination of strategies can be of help. 

3 Iterated elimination of strategies I 

3.1 Elimination of strictly dominated strategies 

We assumed that each player is rational. So when searching for an outcome that is optimal 
for all players we can safely remove strategies that are strictly dominated by some other 
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strategy. This can be done in a number of ways. For example, we could remove all or 
some strictly dominated strategies simultaneously, or start removing them in a round 
robin fashion starting with, say, player 1. To discuss this matter more rigorously we 
introduce the notion of a restriction of a game. 

Given a game G := (S*!, . . . , S'„,joi, . . . ,p„) and (possibly empty) sets of strategies 
Ri, . . . ,Rn such that i?i C for z G {1, . . . , we say that R := (-Ri, . . . , Rn,Pi, • • • , Pn) 
is a restriction of G. Here of course we view each Pi clS cL function on the subset 
Ri X . . . X Rn of Si X . . . X Sn- In what follows, given a restriction R we denote by Ri the 
set of strategies of player i in R. 

We now introduce the following notion of reduction between the restrictions R and R' 
of G: 

R^s R' 

when R^ R\\/ie{l,..., n} R[ C R^ and 

Vz G {1, . . . , n} Vsj E Ri\ R'i 3s ■ G Ri Si is strictly dominated in i? by s[. 

That is, i?— T-gi?' when i?' results from R by removing from it some strictly dominated 
strategies. 

In general an elimination of strictly dominated strategies is not a one step process; it 
is an iterative procedure. Its use is justified by the assumption of common knowledge of 
rationality. 

Example 3.1. Consider the following game: 





L 


M 


R 


T 


3,0 


2,1 


1,0 


C 


2,1 


1,1 


1,0 


B 


0,1 


0,1 


0,0 



Note that B is strictly dominated by T and R is strictly dominated by M. By elimi- 
nating these two strategies we get: 



M 



T 
C 



T 



3,0 


2,1 


2,1 


1,1 


so we g 


et: 


L 


M 


3,0 


2,1 



In this game L is strictly dominated by M, so we finally get: 

M 

T I 2,1 



□ 
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This brings us to the following notion, where given a binary relation — )■ we denote by 
— )■ * its transitive reflexive closure. Consider a strategic game G. Suppose that G -^s-^, 
i.e., R is obtained by an iterated elimination of strictly dominated strategies, in short 
lESDS, starting with G. 

• If for no restriction R' of G, R — J-g-R' holds, we say that R is an outcome of 
lESDS from G. 

• If each player is left in R with exactly one strategy, we say that G is solved by 
lESDS. 

The following simple result clarifies the relation between the lESDS and Nash equi- 
librium. 

Theorem 3.2 (lESDS). Suppose that G' is an outcome of lESDS from a strategic game 
G. 

(i) If s is a Nash equilibrium of G, then it is a Nash equilibrium of G' . 

(a) If G is finite and s is a Nash equilibrium of G' , then it is a Nash equilibrium of G. 

(Hi) If G is finite and solved by lESDS, then the resulting joint strategy is a unique Nash 
equilibrium. 

Exercise 1. Provide the proof. □ 
Exam ple 3.3. A nice example of a game that is solved by lESDS is the location game 



due to iHotellingl |1929| . Assume that that the players are two vendors who simultaneously 
choose a location. Then the customers choose the closest vendor. The profit for each 
vendor equals the number of customers it attracted. 

To be more specific we assume that the vendors choose a location from the set 
{1, . . . ,n} of natural numbers, viewed as points on a real line, and that at each loca- 
tion there is exactly one customer. For example, for n = 11 we have 11 locations: 



and when the players choose respectively the locations 3 and 8: 

I 

8 



we have pi(3, 8) = 5 and P2(3, 8) = 6. When the vendors 'share' a customer, they end up 
with a fractional payoff. 

In general, we have the following game: 

• each set of strategies consists of the set {1, . . . , n}. 
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each payoff function pi is defined by: 

Si + S3„i - 1 



if Si < S3. 



Pi{Si, S3_i) := < 



Si + S3-i - 1 

n if Si > S3. 



n 
2 



if Si = S3. 



It is easy to see tliat for n = 2A; + 1 tliis game is solved by k rounds of lESDS, and 
that each player is left with the 'middle' strategy k. In each round both 'outer' strategies 
are eliminated, so first 1 and n, and so on. □ 

There is one more natural question that we left so far unanswered. Is the outcome of an 
iterated elimination of strictly dominated strategies unique, or in game theory parlance: 
is strict dominance order indep endent! Th e answer is positive. The fo llowing result 



was established independently by iGilboa et al.l |1990| and IStegemaru |1990 



Theorem 3.4 (Order Independence I). Given a finite strategic game all iterated elimi- 
nations of strictly dominated strategies yield the same outcome. 



As noted by iDufwenberg and Stegemad |2002l | the above result does not hold for infi- 
nite strategic games. 

Example 3.5. Consider a game in which the set of strategies for each player is the set 
of natural numbers. The payoff to each player is the number (strategy) he selected. 

Note that in this game every strategy is strictly dominated. Consider now three ways 
of using lESDS: 

• by removing in one step all strategies that are strictly dominated, 

• by removing in one step all strategies different from that are strictly dominated, 

• by removing in each step exactly one strategy. 

In the first case we obtain the restriction with the empty strategy sets, in the second 
one we end up with the restriction in which each player has just one strategy, 0, and in 
the third case we obtain an infinite sequence of reductions. □ 

The above example shows that in the limit of an infinite sequence of reductions different 
outcomes can be reached. So for infinite games the definition of the order independenc e has 
to be mod ified. An interested reader is referred to IDufwenberg and StegemanI 2002| and 
AptI 20071 ] where two different options are proposed and some limited order independence 
results are established. 

The above example also shows that in the lESDS Theorem I3.2( u) and {Hi) we cannot 
drop the assumption that the game is finite. Indeed, the above infinite game has no 
Nash equilibria, while the game in which each player has exactly one strategy has a Nash 
equilibrium. 
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3.2 Elimination of weakly dominated strategies 



Analogous considerations can be carried out for the elimination of weakly dominated 
strategies, by considering the appropriate reduction relation — )-vi/ defined in the ex- 
pected way. Below we abbreviate iterated elimination of weakly dominated strategies 
to lEWDS. 

However, in the case of lEWDS some complications arise. To illustrate them consider 
the following game that results from equipping each player in the Matching Pennies game 
with a third strategy E (for Edge): 





H 


T 


E 


H 


1,-1 


-1, 1 


-1,-1 


T 


-1, 1 


1,-1 


-1,-1 


E 


-1,-1 


-1,-1 


-1,-1 



Note that 

• {E, E) is its only Nash equilibrium, 

• for each player, E is the only strategy that is weakly dominated. 



Any form of elimination of these two E strategies, simultaneous or iterated, yields 
the same outcome, namely the Matching Pennies game, that, as we have already noticed, 
has no Nash equilibrium. So during this eliminating process we 'lost' the only Nash 
equilibrium. In other words, part (z) of the lESDS Theorem 13.21 does not hold when 
reformulated for weak dominance. 

On the other hand, some partial results are still valid here. 

Theorem 3.6 (lEWDS). Suppose that G is a finite strategic game. 

(i) If G' is an outcome of IE WD S from G and s is a Nash equilibrium of G' , then s is 
a Nash equilibrium of G. 

(a) If G is solved by lEWDS, then the resulting joint strategy is a Nash equilibrium of 
G. 



Exercise 2. Provide the proof. □ 

Example 3.7 . A nice examp le of a game that is solved by lEWDS is the Beauty Contest 
game due to iMoulin In this game there are n > 2 players, each with the set of 



strategies equal {1, . . . , 100}. Each player submits a number and the payoff to each player 
is obtained by splitting 1 equally between the players whose submitted number is closest 
to I of the average. For example, if the submissions are 29, 32, 29, then the payoffs are 
respectively |, 0, 1. 

One can check that this game is solved by lEWDS and results in the joint strategy 
(1, . . . , 1). Hence, by the lEWDS Theorem 13.61 this joint strategy is a (not necessarily 
unique; we shall return to this question in Section Nash equilibrium. □ 
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Exercise 3. Show that the Beauty Contest game is indeed solved by lEWDS. 



□ 



Note that in contrast to the lESDS Theorem 13.21 we do not claim in part (ii) of the 
lEWDS Theorem 13.61 that the resulting joint strategy is a unique Nash equilibrium. In 
fact, such a stronger claim does not hold. Further, in contrast to strict dominance, an 
iterated elimination of weakly dominated strategies can yield several outcomes. 

The following example reveals even more peculiarities of this procedure. 

Example 3.8. Consider the following game: 



L M R 



0,1 


1,0 


0,0 


0,0 


0,0 


1,0 



It has three Nash equilibria, {T,L), {B,L) and {B,R). This game can be solved by 
lEWDS but only if in the first round we do not eliminate all weakly dominated strategies, 
which are M and R. If we eliminate only R, then we reach the game 



L 



M 



T 
B 



0,1 


1,0 


0,0 


0,0 



that is solved by lEWDS by eliminating B and M. This yields 

L 



T 0,1 



So not only lEWDS is not order independent; in some games it is advantageous not to 
proceed with the deletion of the weakly dominated strategies 'at full speed'. The reader 
may also check that the second Nash equilibrium, (S, L), can be found using lEWDS, as 
well, but not the third one, {B,R). 

□ 



To summarise, the iterated elimination of weakly dominated strategies 



• can lead to a deletion of Nash equilibria, 

• does not need to yield a unique outcome, 

• can be too restrictive if we stipulate that in each round all weakly dominated strate- 
gies are eliminated. 

Finally, note that the above lEWDS Theorem 13.61 does not hold for infinite games. 
Indeed, Example 13.51 applies here, as well. 
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3.3 Elimination of never best responses 



Finally, we consider the process of eliminating strategies that are never best responses 
to a joint strategy of the opponents. To motivate this procedure consider the following 
game: 





X 


Y 


A 


2,1 


0,0 


B 


0,1 


2,0 


C 


1,1 


1,2 



Here no strategy is strictly or weakly dominated. However, C is a never best re- 
sponse, that is, it is not a best response to any strategy of the opponent. Indeed, A is 
a unique best response to X and 5 is a unique best response to Y . Clearly, the above 
game is solved by an iterated elimination of never best responses. So this procedure can 
be stronger than lESDS and lEWDS. 

Formally, we introduce the following reduction notion between the restrictions R and 
R! of a given strategic game G: 

R — R' 

when R^ R',yie{l,..., n} R[ C R^ and 

Vi G {1, . . . , 7T,} Vsj E Ri\R[ -i3s_j G R-i Si is a best response to s_j in R. 

That is, -R— T-Tvi?' when R' results from R by removing from it some strategies that are 
never best responses. 

We then focus on the iterated elimination of never best responses, in short lENBR, 
obtained by using the — j-^ relation. The following counterpart of the lESDS Theorem 
Othen holds. 

Theorem 3.9 (lENBR). Suppose that G' is an outcome of lENBR from a strategic game 
G. 

(i) If s is a Nash equilibrium of G, then it is a Nash equilibrium of G' . 

(a) If G is finite and s is a Nash equilibrium of G' , then it is a Nash equilibrium of G. 

(Hi) If G is finite and solved by lENBR, then the resulting joint strategy is a unique Nash 
equilibrium. 



Exercise 4. Provide the proof. 



□ 



Further, as shown by lAptl |2005|], we have the following analogue of the Order Inde- 
pendence I Theorem 13. 4[ 

Theorem 3.10 (Order Independence II). Given a finite strategic game all iterated elim- 
inations of never best responses yield the same outcome. 
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In the case of infinite games we encounter the same problems as in the case of lESDS 
as Example 13.51 readily applies to lENBR, as well. In particular, if we solve an infinite 
game by lENBR we cannot claim that we obtained a Nash equilibrium. Still, lENBR can 
be useful in such cases. 

Example 3.11. Consider the following infinite variant of the location game considered in 
Example 13.31 We assume that the players choose their strategies from the open interval 
(0, 100) and that at each real in (0, 100) there resides one customer. We have then the 
following payoffs that correspond to the intuition that the customers choose the closest 
vendor: 



2 



if Si < S3. 



100 -^i^^ ifs,>.3- 



50 if Si = S3_i. 

It is easy to check that in this game no strategy strictly or weakly dominates another 
one. On the other hand each strategy 50 is a best response to some strategy, namely to 
50, and no other strategies are best responses. So this game is solved by lENBR, in one 
step. We cannot claim automatically that the resulting joint strategy (50, 50) is a Nash 
equilibrium, but it is straightforward to check that this is the case. Moreover, by the 
lENBR Theorem I3.9( z) we know that this is a unique Nash equilibrium. □ 



4 Mixed extension 

We now study a special case of infinite strategic games that are obtained in a canonical 
way from the finite games, by allowing mixed strategies. Below [0, 1] stands for the real 
interval {rGM|0<r<l}. By a probability distribution over a finite non-empty 
set A we mean a function 

TT : [0,1] 

such that '^aeA'^i^) ~ ^- denote the set of probability distributions over A by AA. 

Consider now a finite strategic game G := {Si, . . . , Sn,Pi, ■ ■ ■ ,Pn)- By a mixed strat- 
egy of player i in G we mean a probability distribution over Si. So ASi is the set of mixed 
strategies available to player i. In what follows, we denote a mixed strategy of player i 
by nii and a joint mixed strategy of the players by m. 

Given a mixed strategy rrii of player i we define 

supportinii) := {a E Si \ rrii^a) > 0} 

and call this set the support of rrii. In specific examples we write a mixed strategy rrii 
as the sum ^^jg^^ fni{a) ■ a, where A is the support of rrii. 

Note that in contrast to Si the set ASi is infinite. When referring to the mixed 
strategies, as in the previous sections, we use the notation. So for m G ASi x . . . x ASn 
we have m„j = {mj)j^i, etc. 

We can identify each strategy Sj G Si with the mixed strategy that puts 'all the weight' 
on the strategy Sj. In this context Si will be called a pure strategy. Consequently we 
can view Si as a subset of ASi and S'_j as a subset of Xj^iASj. 
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By a mixed extension of {Si, . . . , Sn,Pi, ■ ■ ■ ,Pn) we mean the strategic game 

(AS"!, . . . , A^^,^!, . . . ,pn), 

where each function pi is extended in a canonical way from 5* := 5*1 x . . . x 5'„ to M : = 
AS*! X ... X ASn by first viewing each joint mixed strategy m = (mi, . . . , m„) G M as a 
probabihty distribution over S, by putting for s G 

m{s) := mi(si) ■ . . . ■ m„(s„), 

and then by putting 

Pi{m) := J^m(s) ■pi(s). 

The notion of a Nash equihbrium readily applies to mixed extensions. In this context 
we talk about a pure Nash equilibrium, when each of the constituent strategies is pure, 
and refer to an arbitrary Nash equilibrium of the mixed extension as a Nash equilibrium 
in mixed strategies of the initial finite game. In what follows, when we use the letter 
m we implicitly refer to the latter Nash equilibrium. 

Lemma 4.1 (Characterisation). Consider a finite strategic game 
{Si, . . . , Sn, Pi,...,Pn). The following statements are equivalent: 

(i) m is a Nash equilibrium in mixed strategies, i.e., 

Pi{m) > pi{m[,m_i) 

for all i E {1, . . . ,n} and all m- G ASj, 

(ii) for all i E {1, . . . ,n] and all Sj G Si 

Pi{m) > Pi{si,m_i), 

(Hi) for all i E {I, . . . ,n} and all Si G support{mi) 

Pi{m) =pi{si,m_i) 
and for all i E {1, . . . ,n} and all Si ^ support{mi) 

Pi{m) > pi{si,m_i). 

Exercise 5. Provide the proof. □ 

Note that the equivalence between {i) and {ii) implies that each Nash equilibrium of 
the initial game is a pure Nash equilibrium of the mixed extension. In turn, the equivalence 
between {i) and {Hi) provides us with a straightforward way of testing whether a joint 
mixed strategy is a Nash equilibrium. 
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We now illustrate the use of the above theorem by finding in the Battle of the Sexes 
game a Nash equilibrium in mixed strategies, in addition to the two pure ones exhibited 
in Section [31 Take 

mi := ri ■ F + (1 — ri) ■ B, 
1712 := r2 ■ F + {1 - r2) ■ B, 

where < ri , r2 < 1 . By definition 



Pi(mi, m2) = 2 ■ ri ■ r2 + (1 - ri) ■ (1 - 72] 
P2inii, 1122) = ri ■ r2 + 2 ■ (1 - ri) ■ (1 - 72] 



Suppose now that (mi,m2) is a Nash equilibrium in mixed strategies. By the equiv- 
alence between (i) and (in) of the Characterisation Lemma [4.11 pi (F. Tno) = pi(i?,m2), 
i.e., (using ri = 1 and ri = in the above formula for Pi{-)) 2-72 = 1 — r2, and 
P2{mi,F) = p2{mi,B), i.e., (using r2 = 1 and r2 = in the above formula for P2{-)) 
ri = 2 ■ (1 — ri). So r2 = I and ri = |. 

This implies that for these values of ri and r2, (mi, m2) is a Nash equilibrium in mixed 
strategies and we have 

J9i(mi,m2) =P2(mi,m2) = |. 

The example of the Matching Pennies game illustrated that some strategic games do 
not have a Nash equilibrium. In the case of mix ed extension s the situation changes and 
we have the following fundamental result due to Nash IQSd . 



Theorem 4.2 (Nash). Every mixed extension of a finite strategic game has a Nash equi- 
librium. 

In other words, every finite strategic game has a Nash equilibrium in mixed strategies. 
In the case of the Matching Pennies game it is straightforward to check that ■ H + ^ ■ 
T, I ■ + 1 ■ T) is such a Nash equilibrium. In this equilibrium the payoffs to each player 
are 0. 

Nash's Theorem follows directly from the following result due to Kakutani 194lj j§ 



Theorem 4.3 (Kakutani). Suppose that A is a non-empty compact and convex subset of 
IZ" and 

$ : yl->P(A) 

such that 

• $(a;) is non-empty and convex for all x E A, 

• the graph of^, so the set {{x,y) \ y G $(x)}, is closed. 

Then x* e A exists such that x* e ^(x*). □ 



^Recall that a subset A of R" is called compact if it is elosed and bounded, and is called convex if 
for any x, y G A and a £ [0, 1] we have ax + (1 — a)y G A. 
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Proof of Nash's Theorem. Fix a finite strategic game (5*1, . . . , Sn,Pi, ■ ■ ■ ,Pn)- Define the 
function besti : Xj-^^ASj — )■ V{ASi) by 

bestiijn^i) := {rrii G ASi | is a best response to m_j}. 

Then define the function best : ASi x . . . x AS'„ — V{ASi x . . . x ASn) by 

best{m) := besti{m_i) x . . . x 6esti(m_„). 

It is now straightforward to check that m is a Nash equilibrium iff m G best{m). More- 
over, one can easily check that the function best{-) satisfies the conditions of Kakutani's 
Theorem. The fact that for every joint mixed strategy m, best{m) is non-empty is a di- 
rect consequence of the Extreme Value Theorem stating that every real- valued continuous 
function on a compact subset of TZ^ attains a maximum. □ 



5 Iterated elimination of strategies II 

The notions of dominance apply in particular to mixed extensions of finite strategic games. 
But we can also consider dominance of a pure strategy by a mixed strategy. Given a finite 
strategic game G := {Si, . . . , Sn,Pi, ■ ■ ■ ,Pn), we say that a (pure) strategy Si of player i is 
strictly dominated by a mixed strategy mi if 

Vs_i G S^i pi{mi, s^i) > pi{si, s-i), 

and that Si is weakly dominated by a mixed strategy nii if 

Vs_i G S^i pi{mi, s„i) > pi{si, s_i) and 3s„i G S^i Pi{mi, > pi{si, S-i). 

In what follows we discuss for these two forms of dominance the counterparts of the 
results presented in Section [31 

5.1 Elimination of strictly dominated strategies 

Strict dominance by a mixed strategy leads to a stronger notion of strategy elimination. 
For example, in the game 





L 


R 


T 


2,1 


0,1 


M 


0,1 


2,1 


B 


0,1 


0,1 



the strategy B is strictly dominated neither by T nor M but is strictly dominated by 
i-T + l-M. 

We now focus on iterated elimination of pure strategies that are strictly dominated 
by a mixed strategy. As in Section |3] we would like to clarify whether it affects the Nash 
equilibria, in this case equilibria in mixed strategies. 
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Instead of the lengthy wording 'the iterated ehmination of strategies strictly dominated 
by a mixed strategy' we write lESDMS . We have then the following counterpart of the 
lESDS Theorem 13.2^ where we refer to Nash equilibria in mixed strategies. Given a 
restriction G' of G and a joint mixed strategy m of G, when we say that m is a Nash 
equihbrium of G' we implicitly stipulate that each strategy used (with positive probability) 
in m is a strategy in G'. 

Theorem 5.1 (lESDMS). Suppose that G is a finite strategic game. 

(i) If G' is an outcome of lESDMS from G, then m is a Nash equilibrium of G iff it is 
a Nash equilibrium of G' . 

(a) If G is solved by lESDMS, then the resulting joint strategy is a unique Nash equilib- 
rium of G (in, possibly, mixed strategies). 

Exercise 6. Provide the proof. □ 

To illustrate the use of this result let us return to the Beauty Contest game discussed 
in Example 13.71 We explained there why (1, . . . , 1) is a Nash equilibrium. Now we can 
draw a stronger conclusion. 

Example 5.2. One can show that the Beauty Contest game is solved by lESDMS in 99 
rounds. In each round the highest strategy of each player is removed and eventually each 
player is left with the strategy 1. On account of the above theorem we now conclude that 
(1, . . . , 1) is a unique Nash equilibrium. □ 

Exercise 7. Show that the Beauty Contest game is indeed solved by lESDMS in 99 
rounds. □ 

As in the case of strict dominance by a pure strategy we now address the question 
of whether the outcome of lESD MS is unique. The answer , as b efore, is positive. The 



following result was established by lOsborne and RubinsteinI |1994 



Theorem 5.3 (Order independence III). All iterated eliminations of strategies strictly 
dominated by a mixed strategy yield the same outcome. 



5.2 Elimination of weakly dominated strategies 

Next, we consider iterated elimination of pure strategies that are weakly dominated by a 
mixed strategy. 

As already noticed in Subsection 13.21 an elimination by means of weakly dominated 
strategies can result in a loss of Nash equilibria. Clearly, the same observation applies 
here. We also have the following counterpart of the lEWDS Theorem 13. 6[ where we refer 
to Nash equilibria in mixed strategies. Instead of 'the iterated elimination of strategies 
weakly dominated by a mixed strategy' we write lEWDMS . 

Theorem 5.4 (lEWDMS). Suppose that G is a finite strategic game. 
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(i) If G' is an outcome of lEWDMS from G and m is a Nash equilibrium of G' , then 
m is a Nash equilibrium of G. 

(a) If G is solved by lEWDMS, then the resulting joint strategy is a Nash equilibrium of 
G. 

Here is a simple application of this theorem. 

Corollary 5.5. Every mixed extension of a finite strategic game has a Nash equilibrium 
such that no strategy used in it is weakly dominated by a mixed strategy. 

Proof. It suffices to apply Nash's Theorem 14.21 to an outcome of lEWDMS and use item 
(i) of the above theorem. □ 

Finally, observe that the outcome of lEWMDS does not need to be unique. In fact, 
Example 13.81 applies here, as well. 

5.3 Rationalizability 

Finally, we consider iterated elimination of strategi es that ar e neve r bes t responses t o 



a joint mixed strategy of the opponents. Following iBernheimI |1984l | and iPearcd |1984 
strategies that survive such an elimination process are called rationalizable strategiesjj 

Formally, we define rationalizable strategies as follows. Consider a restriction i? of a 
finite strategic game G. Let 

TZATiR) ■■= iS[,...,S'J, 

where for alH G { 1 , . . . , n} 

S'^ := {si G Ri I 3m_i G Xj-^^ARj Si is a best response to m_j in G}. 

Note the use of G instead of R in the definition of S'^. We shall comment on it below. 

Consider now the outcome G-jiAT of iterating IZAT starting with G. We call then the 
strategies present in the restriction G-jiat rationalizable. 



We have the following counterpart of the lESDMS Theorem 15.11 due to iBernheim 



1984 



Theorem 5.6. Assume a finite strategic game G. 

(i) Then m is a Nash equilibrium of G iff it is a Nash equilibrium of G-jiAT- 

(a) If each player has in G-jiji.j- exactly one strategy, then the resulting joint strategy is 
a unique Nash equilibrium of G. 

Exercise 8. Provide the proof. □ 



■^Morc precisely, in each of these papers a different definition is used; see I Aptl 2007| for an analysis of 
the conditions for which these definitions coincide. 
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In the context of rationalizability a joint mixed strategy of the opponents is referred to 
as a belief. The definition of rationahzabihty is generic in the class of behefs w.r.t. which 
best responses are collected. For example, we could use here joint pure strategies of 
the opponents, or probability distributions over the Cartesian product of the opponents' 
strategy sets, so the elements of the set AS^i (extending in an expected way the payoff 
functions). In the first case we talk about point beliefs and in the second case about 
correlated beliefs. 

In the case of point beliefs we can apply the elimination procedure entailed by TZAT 
to arbitrary games. To avoid discussion of the outcomes reached in the case of infinite 
iterations we focus on a result for a limited case. We refer here to Nash equilibria in pure 
strategies. 

Theorem 5.7. Assume a strategic game G. Consider the definition of the TZAT operator 
for the case of point beliefs and suppose that the outcome Gm^j- is reached in finitely many 
steps. 

(i) Then s is a Nash equilibrium of G iff it is a Nash equilibrium of G-ji^at- 

(a) If each player is left in G-rat with exactly one strategy, then the resulting joint 
strategy is a unique Nash equilibrium of G. 



Exercise 9. Provide the proof. 



□ 



A subtle point is that when G is infinite, the restriction Gti^aj- may have empty strategy 
sets (and hence no joint strategy). 



1883 



IS a 



Example 5.8. Bertrand competition, originally proposed by iBertrand 
game concerned with a simultaneous selection of prices for the same product by two 
firms. The product is then sold by the firm that chose a lower price. In the case of a tie 
the product is sold by both firms and the profits are split. 

Consider a version in which the range of possible prices is the left-open real interval 
(0, 100] and the demand equals 100 — p, where p is the lower price. So in this game G 
there are two players, each with the set (0, 100] of strategies and the payoff functions are 
defined by: 



'si(lOO-si) 
si(100 - si) 



if Si < $2 

if Si = S2 
if Si > S2 



P2{Si,S2) 



52(100 -S2) 
^2(100-32) 

2 





if S2 < si 

if Si = $2 
if $2 > Si. 



Consider now each player's best responses to the strategies of the opponent. Since 
Si = 50 maximises the value of Si(100 — Si) in the interval (0, 100], the strategy 50 is 
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the unique best response of the first player to any strategy S2 > 50 of the second player. 
Further, no strategy is a best response to a strategy S2 < 50. By symmetry the same 
holds for the strategies of the second player. 

So the elimination of never best responses leaves each player with a single strategy, 
50. In the second round we need to consider the best responses to these two strategies 
in the original game G. In G the strategy si = 49 is a better response to S2 = 50 than 
Si = 50 and symmetrically for the second player. So in the second round of elimination 
both strategies 50 are eliminated and we reach the restriction with the empty strategy 
sets. By Theorem 15.71 we conclude that the original game G has no Nash equilibrium. 

□ 

Note that if we defined S'^ in the definition of the operator TZAT using the restriction 
R instead of the original game G, the iteration would stop in the above example after 
the first round. Such a modified definition of the TZAT operator is actually an instance 
of the lENBR (iterated elimination of never best responses) in which at each stage all 
never best responses are eliminated. So for the above game G we can then conclude by 
the lENBR Theorem I3.9( z) that it has at most one equilibrium, namely (50, 50), and then 
check separately that in fact it is not a Nash equilibrium. 



5.4 A comparison between the introduced notions 



We introduced so far the notions of strict dominance, weak dominance, and a best re- 
sponse, and related them to the notion of a Nash equilibrium. To conclude this section 
we clarify the connections between the notions of dominance and of best response. 

Clearly, if a strategy is strictly dominated, then it is a never best response. However, 
the converse fails. Further, there is no relation between the notions of weak dominance 
and never best response. Indeed, in the game considered in Subsection 13.31 strategy C is a 
never best response, yet it is neither strictly nor weakly dominated. Further, in the game 
given in Example 13.81 strategy M is weakly dominated and is also a best response to B. 

The situation changes in the case of mixed extensions of two-player finite games. 
Below, by a totally mixed strategy we mean a mixed strategy with full support, i.e., 
one in which each strateg y is used wit h a strictly positive probability. The following 
results were established by iPearcd 1984 . 



Theorem 5.9. Consider a finite two-player strategic game. 

(i) A pure strategy is strictly dominated by a mixed strategy iff it is not a best response 
to a mixed strategy. 

(a) A pure strategy is weakly dominated by a mixed strategy iff it is not a best response 
to a totally mixed strategy. 



We only prove here part (z). iPearcd 1984| provides a short, but a bit tricky proo f 



based on Nash's Theorem 14.21 The proof we provide, due to lFudenberg and Tirold 1991 
is a bit more intuitive. 



We shall use the following result, see, e.g., iRockafellarl |1996 
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Theorem 5.10 (Separating Hyperplane). Let A and B be disjoint convex subsets ofM.^. 
Then there exists a non-zero c G M'^ and d G M such that 

c - X > d for all x & A, 

c ■ y < d for all y E B. 

Proof of Theorem \5.yi i). 

Clearly, if a pure strategy is strictly dominated by a mixed strategy, then it is not a 
best response to a mixed strategy. To prove the converse, fix a two-player strategic game 
(S'l, S'2,pi,P2)- Also fix z G {1,2} and abbreviate 3 — z to —i. 

Suppose that a strategy Si G Si is not strictly dominated by a mixed strategy. Let 

A:={xe Rl^-'l I Vs_i G S^i x,_^ > 0} 

and 

B := {{pi{mi,s^i) - pi{si,s.i))s_^es^, I "^i e ASi}. 

By the choice of Sj the sets A and B are disjoint. Moreover, both sets are convex subsets 
of Rl^-< 

By the Separating Hyperplane Theorem 15. 101 for some non-zero c G R'"^"'' and d G M 

c ■ X > d for all X E A, (1) 

c-y <dioT ally e B. (2) 

But G -B, so by ([2]) d > 0. Hence by ([T]) and the definition of A for all s_i G S^i we 
have Cs_. > 0. Again by ([T]) and the definition of A this excludes the contingency that 
d>0, i.e., d = 0. Hence by ([2]) 

E._,G5_, c,_,pi(mi, < Es_,e5_, Cs^,pi(si, for all G A^^. (3) 

Let c := J2s^,eS-i -^^ assumption c 7^ 0. Take 

Then ([3]) can be rewritten as 

Pi{mi, rri-i) < pi{si, m_i) for all G ASi, 
i.e., Sj is a best response to m_j. □ 
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6 Variations on the definition of strategic games 



The notion of a strategic game is quantitative in the sense that it refers through payoffs 
to real numbers. A natural question to ask is: do the payoff values matter? The answer 
depends on which concepts we want to study. We mention here three qualitative variants 
of the definition of a strategic game in which the payoffs are replaced by preferences. By 
a pr eference relation on a s e t A w e mean here a linear order on A. 



In 



Osborne and RubinsteinI |l994j a strategic game is defined as a sequence 



{Si, . . . , Sn, ^ 



1) 



where each is player's i preference relation defined on the set 5*1 x 
strate gies. 



X Sn of joint 



In lApt et al.l |2008| another modification of strategic games is considered, called a 
strategic game with parametrised preferences . In this approach each player i has 
a non-empty set of strategies Si and a pr eference relati on on Si parametrised 
by a joint strategy s_j of his opponents. In lApt et al.l |2008| only strict preferences were 
considered and so defined finite games with parametrised preferences were compared with 
the concept of CP-nets (Conditional Preference nets), a formal i sm us ed for representing 
conditional and qualitative pr eferences, see, e.g., iBoutiher et al.l [2004 . 

Next, in Roux et al.l j2008 | conversion/preference games are introduced. Such a 
game for n players consists of a set 5" of situations and for each player i a preference 
relation ^i on S and a conversion relation — )■ j on S*. The definition is very general 
and no conditions are placed on the preference and conversion relations. These games are 
used to formalise gene regulation networks and some aspects of security. 

Finally, let us men tion another genera lisation of strategic games, called graphical 
games, introduced by iKearns et al.l 200 1| . These games stress the locality in taking a 
decision. In a graphical game the payoff of each player depends only on the strategies of 
its neighbours in a given in advance graph structure over the set of players. Formally, 
such a game for n players with the corresponding strategy sets Si, . . . , Sn is defined by 
assuming a neighbour function N that given a player i yields its set of neighbours N{i). 
The payoff for player i is then a function pi from Xjg7v(j)u{j}S'j to M. 

In all mentioned variants it is straightforward to define the notion of a Nash equi- 
librium. For example, in the conversion/preferences games it is defined as a situation s 
such that for all players i, if s — )■ is', then s' )fi s. However, other introduced notions 
can be defined only for some variants. In particular, Pareto efficiency cannot be defined 
for strategic games with parametrised preferences since it requires a comparison of two 
arbitrary joint strategies. In turn, the notions of dominance cannot be defined for the 
conversion/preferences games, since they require the concept of a strategy for a player. 

Various results concerning finite strategic games, fo r instance the lESDS Theorem 13.21 



ca rry over directly to the strategic games as defined in lOsborne and RubinsteinI |1994 



m 



or 



Apt et al.l |2008| . On the other hand, in the variants of strategic games that rely on the 



notion of a preference we cannot consider mixed strategies, since the outcomes of playing 
different strategies by a player cannot be aggregated. 
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7 Mechanism design 



Mechanism design is one of the important areas of economics. The 2007 Nobel Prize in 

Economics went to three economists who laid its foundations. To quote from lThe Economist 2007 
mechanism design deals with the problem of 'how to arrange our economic interactions 
so that, when everyone behaves in a self-interested manner, the result is something we all 
like'. So these interactions are supposed to yield desired social decisions when each agent 
is interested in maximising only his own utility. 

In mechanism design one is interested in the ways of inducing the players to submit 
true information. This subject is closely related to game theory, though it focuses on 
other issues. In the next section we shall clarify this connection. To discuss mechanism 
design in more detail we need to introduce some basic concepts. 

Assume a set {1, . . . , n} of players with n > 1, a non-empty set of decisions D, and 
for each player i 



• a non-empty set of types 0j, and 

• an initial utility function Vi : D x Oj — )• M. 



In this context a type is some private information known only to the player, for example, 
in the case of an auction, the player's valuation of the items for sale. 

When discussing types and sets of types we use then the same abbreviations as in 
SectionO In particular, we define := ©i x ■ ■ ■ x 6„ and for 6* G O we have {9i, O^i) = 9. 

A decision rule is a function f : Q ^ D. We call the tuple 

{D,Qi,...,en,Vl,...,VnJ) 

a decision problem. 

Decision problems are considered in the presence of a central authority who takes 
decisions on the basis of the information provided by the players. Given a decision problem 
the desired decision is obtained through the following sequence of events, where / is a 
given, publicly known, decision rule: 

• each player i receives (becomes aware of) his type 9i E Qi, 

• each player i announces to the central authority a type 6^ G O^; this yields a joint 
type e':=K,...,0, 

• the central authority then takes the decision d := f{9') and communicates it to each 
player, 

• the resulting initial utility for player i is then Vi{d, 6i). 

The difficulty in taking decisions through the above described sequence of events is 
that players are assumed to be rational, that is they want to maximise their utility. As a 
result they may submit false information to manipulate the outcome (decision). To better 
understand the notion of a decision problem consider the following two natural examples. 
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Example 7.1. [Sealed-bid Auction] 

We consider a sealed-bid auction in which there is a single object for sale. Each 
player (bidder) simultaneously submits to the central authority his type (bid) in a sealed 
envelope and the object is allocated to the highest bidder. 

Given a sequence a := (ai, . . . , aj) of reals denote the least / such that ai = max^gji^. ..,,•} 
by argsmax a. Then we can model a sealed-bid auction as the following decision problem 
{D,Qi,..., en,Vu...,VnJ): 

• D = {l,...,n}, 

• for alH G {1, . . . , n}, Qi = M+; 6i G Oi is player's i valuation of the object, 

• for alH G {1, . . . , n}, Vi{d, 9i) := {d = i)6, where d = i is a. Boolean expression with 
the value or 1, 

• f{9) := argsmax 6. 

Here decision d & D indicates to which player the object is sold. Further, f{6) = i, 
where 

9i = maxjg{i^...^„} 9j and Vj G {1, . . . , z — 1} 9j < 9i. 

So we assume that in the case of a tie the object is allocated to the highest bidder with 
the lowest index. 

□ 

Example 7.2. [Public project problem] 

This problem deals with the task of taking a joint decision concerning construction 
of a public good^ for example a bridge. Each player reports to the central authority 
his appreciation of the gain from the project when it takes place. If the sum of the 
appreciations exceeds the cost of the project, the project takes place and each player has 
to pay the same fraction of the cost. Otherwise the project is cancelled. 

This problem corresponds to the following decision problem, where c, with c > 0, is 
the cost of the project: 

• D = {0, 1} (reflecting whether a project is cancelled or takes place), 

• for alH G {1, . . . , n}, 6i = M+, 

• for alH G {1, . . . , n}, Vi{d, 9i) := d{9i - ^), 



1 ifEr=i^.>c 

otherwise. 



• m ■■ 

If the project takes place (c? = 1), ^ is the cost share of the project for each player. □ 



In Economics public goods are so-called not excludable and non-rival goods. To quote from lMankiw 



200 1| : 'People cannot be prevented from using a public good, and one person's enjoyment of a public 



good docs not reduce another person's enjoyment of it.' 
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Let us return now to the decision rules. We call a decision rule / efficient if for all 
e eQ andd' e D 

n n 
4=1 i=l 

Intuitively, this means that for all 6* G O, f{9) is a decision that maximises the initial 
social welfare from a decision d, defined by XlILi '^ii^i ^i)- easy to check that the 
decision rules used in Examples 17. II and 17.21 are efficient. 

Let us return now to the subject of manipulations. As an example, consider the case 
of the public project problem. A player whose type (that is, appreciation of the gain 
from the project) exceeds the cost share ^ should manipulate the outcome and announce 
the type c. This will guarantee that the project will take place, irrespective of the types 
announced by the other players. Analogously, a player whose type is lower than ^ should 
submit the type to minimise the chance that the project will take place. 

To prevent such manipulations we use taxes, which are transfer payments between 
the players and central authority. This leads to a modification of the initial decision 
problem {D, 9i, . . . , 9^, Vi, . . . ,Vn, f) to the following one: 

• the set of decisions is D x M", 

• the decision rule is a function (/, t) : — )■ D x M", where t : 6 — )■ and (/, t){9) : = 

• the final utility function of player i is the function : D x M" x Oj — j- M defined 
by 

Ui{d,ti,. . tn, 6i) := Vi{d, 9i) + tj. 

We call then {D x M", 6i, . . . , 0„, ui, . . . , Un, (/, t)) a direct mechanism and refer to t 
as the tax function. 

So when the received (true) type of player i is 6i and his announced type is 9'^, his 
final utility is 

u,{{f, t){9[, 9.,), 9,) = v,{f{9l 9.,), 9,) + U{9[, 9.,), 

where are the types announced by the other players. 

In each direct mechanism, given the vector 9 of announced types, t{9) := {ti{9), . . . , tn{9)) 
is the vector of the resulting payments. If ti{9) > 0, player i receives from the central 
authority ti{9), and if ti{9) < 0, he pays to the central authority |ti(^)|. 

The following definition then captures the idea that taxes prevent manipulations. We 
say that a direct mechanism with tax function t is incentive compatible if for all ^ G 6, 
i G {1, . . . ,n} and 9- G 6^ 

u,{{f,tm,9^,),0,) > u,{{f,tM,9.,),9,). 

Intuitively, this means that for each player i announcing one's true type {9i) is better than 
announcing another type {9'j). That is, false announcements, i.e., manipulations, do not 
pay off. 

From now on we focus on specific incentive compatible direct mechanisms. Each 
Groves mechanism is a direct mechanism obtained by using a tax function t{-) : = 
(ti(-), . . . , t„(-)), where for alii G {1, . . . , n} 
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• U : Q is defined by ti{9) := g^{6) + hi{6-i), where 

• hi : — )■ R is an arbitrary function. 

Note tliat, not accidentally, v.i{f{6), 6i) + gi{6) is simply tlie initial social welfare from 
the decision f{9). 

Th e impor t ance of Groves mechanisms is then revealed by the following crucial result 
due to iGrovesI |l973| . 



Theorem 7.3 (Groves). Consider a decision problem {D, Gi, . . . , G„, f i, . . . , Vn, f) with 
an efficient decision rule f . Then each Groves mechanism is incentive compatible. 

Proof. The proof is remarkably straightforward. Since / is efficient, for all ^ G 6, 
i G {1, . . . , n} and 6'- G 9j we have 

n 

u,{if, t){e„ d^i), e,) = J2 ^.(/(^^ + 

n 

= u,{{f,tm,9_,),9,). 



□ 



When for a given direct mechanism for all G we have < 0, the mecha- 

nism is called feasible, which means that it can be realised without external financing. 

Each Groves mechanism is uniquely determined by the functions hi, . . ., hn- A special 
case, called the pivotal mechanism, is obtained by using 



hi (e.i) : = - max ^ Vj {d, 

So then 



m = ^Af{d), e,) - max J2 ^.)- 

Hence for all 9 and 2 G {1, . . . , n} we have ti{9) < 0, which means that the pivotal 
mechanism is feasible and that each player needs to make the payment \ti{9) \ to the central 
authority. 

We noted already that the decision rules used in Examples 17.11 and 17.21 are efficient. 
So in each example Groves' Theorem 17.31 applies and in particular the pivotal mechanism 
is incentive compatible. Let us see now the details. 

Re: Example 17.11 Given a sequence 9 of reals we denote by 9* its reordering from the 
largest to the smallest element. So for example, for 9 = (1,5,4,3,2) we have (^-2)2 = 3 
since 9_2 = (1,4,3,2). 
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To compute the taxes in the sealed-bid auction in the case of the pivotal mechanism 
we use the following observation. 



Note 7.4. In the sealed-bid auction we have for the pivotal mechanism 

tm 



-62 if i = argsmaxt 
otherwise. 



Exercise 10. Provide the proof. □ 
So the highest bidder wins the object and pays for it the amount ma x,-^j 6j. 



The resulting sealed-bid auction was introduced by iVickreyl |1961l | and is called a 
Vickrey auction. To illustrate it suppose there are three players, A, B, and C whose 
true types (bids) are respectively 18, 21, and 24. When they bid truthfully the object 
is allocated to player C whose tax (payment) according to Note 17.41 is 21, so the second 
price offered. Table [1] summarises the situation. 



player 


type 


tax 


Ui 


A 


18 








B 


21 








C 


24 


-21 


3 



Table 1: The pivotal mechanism for the sealed-bid auction 

This explains why this auction is alternatively called a second-price auction. By 
Groves' Theorem 17.31 this auction is incentive compatible. In contrast, the first-price 
auction., in which the winner pays the price he offered (so the first, or the highest price), 
is not incentive compatible. Indeed, reconsider the above example. If player C submits 
22 instead of his true type 24, he then wins the object but needs to pay 22 instead of 24. 
More formally, in the direct mechanism corresponding to the first-price auction we have 

^ic((/, t)(18, 21, 22), 24) = 24 - 22 = 2 > = mc((/, t)(18, 21, 24), 24), 

which contradicts incentive compatibility for the joint type (18, 21, 24). □ 

Re: Example 17.21 To compute the taxes in the public project problem in the case of the 
pivotal mechanism we use the following observation. 

Note 7.5. In the public project problem we have for the pivotal mechanism 



t^{e) 



fO if E,v.^.>^cand E;=i^.>c 

0, - if 0, < and Y.U ^ ^ 

if E,y.^.<^cand E;=i%<c 

I - if E,y. > and < ^■ 



25 



Exercise 11. Provide the proof. 



□ 



To illustrate the pivotal mechanism suppose that c = 30 and that there are three 
players, A, B, and C whose true types are respectively 6, 7, and 25. When these types are 
announced the project takes place and Table |2] summarises the taxes that players need to 
pay and their final utilities. The taxes were computed using Note 17.51 



player 


type 


tax 


Ui 


A 


6 





-4 


B 


7 





-3 


C 


25 


-7 


8 



Table 2: The pivotal mechanism for the public project problem 

Suppose now that the true types of players are respectively 4, 3 and 22 and, as before, 
c = 30. When these types are also the announced types, the project does not take place. 
Still, some players need to pay a tax, as Table [3] illustrates. One can show that this 
deficiency is shared by all fea s ible in centive compatible direct mechanisms for the public 



project, see [Mas-Collel et al.l . Il995l page 861-862]. 



player 


type 


tax 


Ui 


A 


4 


-5 


-5 


B 


3 


-6 


-6 


C 


22 









Table 3: The pivotal mechanism for the public project problem 



8 Pre-Bayesian games 



Mechanism design, as introduced in the previous sectio n, can be exp l ained in game 



theoretic terms using pre- Baye sian games, introduced bv lAshlagi et al.l |2006l | (see also 
Hyafil and Boutilier 2004 1 and Aghassi and Bertsimas |2006j |). In strategic games, after 



each player selected his strategy, each player knows the payoff of every other player. This 
is not the case in pre-Bayesian games in which each player has a private type on which 
he can condition his strategy. This distinguishing feature of pre-Bayesian games explains 
why they form a class of games with incomplete information. Formally, they are defined 
as follows. 

Assume a set {l,...,n} of players, where n > 1. A pre-Bayesian game for n 

players consists of 
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• a non-empty set Ai of actions, 

• a non-empty set 6j of types, 

• a payoff function pi : Ai x . . . x An x Qi ^ M., 

for each player i. 

Let A := Ai X . . . X An- In a pre-Bayesian game Nature (an external agent) moves 
first and provides each player i with a type 9i G Gj. Each player knows only his type. 
Subsequently the players simultaneously select their actions. The payoff function of each 
player now depends on his type, so after all players selected their actions, each player 
knows his payoff but does not know the payoffs of the other players. Note that given a 
pre-Bayesian game, every joint type 9 E Q uniquely determines a strategic game, to which 
we refer below clS db ^-game. 

A strategy for player i in a pre-Bayesian game is a function Sj : 6j — > Aj. The previ- 
ously introduced notions can be naturally adjusted to pre-Bayesian games. In particular, 
a joint strategy s(-) := (si (■),..., s„(-)) is called an ex-post equilibrium if 

V6' G 6 Vi G {1, . . . ,72} Wtti G Ai pi{si{6i),s_i{6_i),ei) > pi{ai, s_i{9_i),ei), 

where S-i{9_i) is an abbreviation for the sequence of actions {s j{9 j)) j-Li- 
In turn, a strategy Sj(-) for player i is called dominant if 

\l9i G 0i Va G A pi{si{9i),a^i, 9i) > pi{ai, a_i, 9i). 

So s(-) is an ex-post equilibrium iff for every joint type 6' G 6 the sequence of actions 
(si(6'i), . . . , Sn{9n)) is a Nash equilibrium in the corresponding 6'-game. Further, Sj(-) is a 
dominant strategy of player i iff for every type 6*, G 9^, Si{9i) is a dominant strategy of 
player i in every (6*4, ^„j)-game. 

We also have the following immediate counterpart of the Dominant Strategy Note 12. 1[ 

Note 8.1 (Dominant Strategy). Consider a pre-Bayesian game G. Suppose that s(-) is a 
joint strategy such that each Si{-) is a dominant strategy. Then it is an ex-post equilibrium 
ofG. 

Example 8.2. As an example of a pre-Bayesian game, suppose that 
. Qi = {U,D},Q2 = {L,R], 

• A^ = A2 = {F,B}, 

and consider the pre-Bayesian game uniquely determined by the following four ^-games. 
Here and below we marked the payoffs in Nash equilibria in these ^-games in bold. 
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R 



U 



D 





F 


B 




F 


B 


F 


2. 1 


2,0 


F 


2,0 


2. 1 


B 


0,1 


2,1 


B 


0,0 


2,1 




F 


B 




F 




F 


3,1 


2,0 


F 


3,0 


2,1 


B 


5,1 


4,1 


B 


5,0 


4,1 



This shows that the strategies Si(-) and S2(-) such that 

si(f/) := F, := S, S2(L) = F, S2(/?) = 5 

form here an ex-post equihbrium. □ 

However, there is a crucial difference between strategic games and pre-Bayesian games. 
Example 8.3. Consider the following pre-Bayesian game: 

. ei = {f/,5}, e2 = {L,i?}, 

• Ar = A2 = {C,D}. 

L R 



u 



B 





C 


D 




C 


D 


c 


2,2 


0,0 


C 


2,1 


0,0 


D 


3,0 


1,1 


D 


3,0 


1,2 




C 


D 




C 


D 


C 


1,2 


3,0 


C 


1,1 


3,0 


D 


0,0 


2,1 


D 


0,0 


2,2 



Even though each ^-game has a Nash equilibrium, they are so 'positioned' that the pre- 
Bayesian game has no ex-post equilibrium. Even more, if we consider a mixed extension of 
this game, then the situation does not change. The reason is that no new Nash equilibria 
are then added to the 'constituent' ^-games. (Indeed, each of them is solved by lESDS 
and hence by the lESDMS Theorem I5.1( n) has a unique Nash equilibrium.) This shows 
that a mixed extension of a finite pre-Bayesian game does not need to have an ex-post 
equilibrium, which contrasts with the existence of Nash equilibria in mixed extensions of 
finite strategic games. □ 

To relate pre-Bayesian games to mechanism design we need one more notion. We say 
that a pre-Bayesian game is of a revelation-type if Ai = 0j for all i E {1, . . . ,n}. So in 
a revelation-type pre-Bayesian game the strategies of a player are the functions on his set 
of types. A strategy for player i is called then truth-telling if it is the identity function 
iTi{-) on Qi. 

Now, as explained in lAshlagi et al.l 2006| mechanism design can be viewed as an 



instance of the revelation-type pre-Bayesian games. Indeed, we have the following imme- 
diate, yet revealing observation. 
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Theorem 8.4. Given a direct mechanism 

(/} xM",ei,...,e„, 

associate with it a revelation-type pre-Bayesian game, in which each payoff' function pi is 
defined by 

pm.O-^),e,) :=u,iif,tm,e..),9,). 

Then the mechanism is incentive compatible iff in the associated pre-Bayesian game for 
each player truth-telling is a dominant strategy. 

By Groves's Theorem 17.31 we conclude that in the pre-Bayesian game associated with 
a Groves mechanism, (7ri(-), . . . , 7r„(-)) is a dominant strategy ex-post equilibrium. 



9 Conclusions 



9.1 Bibliographic remarks 



Histor ically, the notion of an equilibrium in a strategic game occurred first in ICournot 



1838j in his study of production levels of a homogeneous product i n a duopoly competi 



tion. The celebrated von Neumann's Minimax Theorem proved by Ivon Neumann! [1928 



establishes an existence of a Nash equilibrium in mixed stra tegies in two -player zero-sum 



19511. uses Brouwer's 



games. An alternative proof of Nash's Theorem, given in iNash 
Fixed Point Theorem. 

Ever since Nash established his celebrated theorem, a search has continued to gen- 
eralise his result to a larger class of games. A motivation for this endeavour has been 
the existence of natural infinite games that are not mixed extensions of finite games. As 



an ex a mple of su ch a n early resu l t let u s mention the following theorem due to iDebreu 



1952|,lFan| [1952| and iGlicksberd |1952 



Theorem 9.1. Consider a strategic game such that 

• each strategy set is a non-empty compact convex subset of a complete metric space, 

• each payoff function pi is continuous and quasi- concave in the ith argument^ 

Then a Nash equilibrium exists. 

More recent work in this area focused on the exis tence of Nas h eq uilibr i a in g ames 
with non-continuous payoff functions, see in particular iReny 



1999 and Bich 2006 



The issue of complexity of findi ng a Nash equilibrium h as been a long standing open 



problem, clarified only recently, see iDaskalakis et al.l |2009j for an account of these devel- 



opments. Iterated eliminatio n of strictly do minated strategies and of weakly dominated 

The corresponding 



strategies was introduced by iGald jl953l | and iLuce and Raiffal [1957 
results summarised in Theorems 13.21 13. 6[ 15.11 and 15.41 are folklore results 



^Recall that the function pi : S is quasi-concave in the ith argument if the set 

{s- e Si I Pi(s-, s_i) > Pi{s)} is convex for all s & S. 
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AptI 2004| provides uniform proofs of various order independence results, including 
the Order Independence Theorems 13.41 and 15. 3[ The comp utational com p lexity of iterated 



elimination of strat egies has been studied starting with iKnuth et al. 
Brandt et al. 2009 clS cL recent contribution. 



19881, and with 



There is a lot of work on formal aspect s of c ommon knowledge and of its c onsequences 



for game theory, see, e.g.. lAumannl |1999| and iBattigalli and Bonannd |1999 



9.2 Suggestions for further reading 

Strategic games form a large research area and we have barely scratched its surface. There 
are several other equilibria notions and various other types of games. 

Many books provide introductions to various areas of game theory, including strategic 
games. Most of them are written f rom the perspec t ive of app l icatio n s to Economics. In the 
1990s the leading textbooks were iMyersonI 1991| , iBinmord 1991| , iFudenberg and Tirole 



1991 1 and Osborne and RubinsteinI 



1994 



Moving to the next decade, lOsbornd 2005l| is an excellent, broad in its scope, un- 
dergraduate level textbook, while iPetersI 2008| is probably the best boo k on the rn arket 
on the graduate level. Undeservedly less known is the shor t and lucid iTiisI 2003|. An 



eleme ntary, sho rt introduct i on, fo cusing on the concepts, is IShoham and Leyton-Brown 
2008] . In turn, iRitzbergerl 2002| is a comprehensive book on strategic games that also 



extensively disc usses extensive games, i.e., games in which the players choose actions 



in turn. Finally, iBinmord |2007] is a thoroughly revised version of iBinmord |1991 



Several textbooks on microeconomics include introduc tory chapters on 



Jehle and Renyi [2000|. Finally, iNisan et al.l |2007l | is a recent collection of surveys and 



ory, including strateg ic games. Two good examples are IMas-Collel et al.l |1995 



ame the- 
and 



introductions to the computational aspects of game theory, with a number of articles 
concerned with strategic games and mechanism design. 



References 

M. Aghassi and D. Bertsimas. Robust game theory. Math. Program., 107(l-2):231-273, 
2006. 

K. R. Apt. Uniform proofs of order independence for various strategy elimination proce- 
dures. The B.E. Journal of Theoretical Economics, 4(1), 2004. (Contributions), Article 



5, 48 pages. Available from http : //xxx . lanl . gov/abs/cs . GT/0403024 



K. R. Apt. Order independence and rationalizability. In Proceedings 10th Conference 
on Theoretical Aspects of Reasoning about Knowledge (TARK '05), pages 22-38. The 



ACM Digital Library, 2005. Available from |http: //portal. acm.org 



K. R. Apt. The many faces of rationalizability. The B.E. Journal of Theo- 
retical Economics, 7(1), 2007. (Topics), Article 18, 39 pages. Available from 



http : //arxiv . org/abs/cs . Gt/0608011 



30 



K. R. Apt, F. Rossi, and K. B. Venable. Comparing the notions of optimality in CP-nets, 
strategic games and soft constraints. Annals of Mathematics and Artificial Intelligence, 
52(l):25-54, 2008. 

I. Ashlagi, D. Monderer, and M. Tennenholtz. Resource selection games with unknown 
number of players. In AAMAS '06: Proceedings 5th Int. Joint Conf. on Autonomous 
Agents and Multiagent Systems, pages 819-825. ACM Press, 2006. 

R. Aumann. Interactive epistemology I: Knowledge. International Journal of Game 
Theory, 28(3):263-300, 1999. 

P. Battigalli and G. Bonanno. Recent results on belief, knowledge and the epistemic 
foundations of game theory. Research in Economics, 53(2):149-225, June 1999. 

B. D. Bernheim. Rationalizable strategic behavior. Econometrica, 52(4):1007-1028, 1984. 

J. Bertrand. Theorie mathematique de la richesse sociale. Journal des Savants, 67:499- 
508, 1883. 

P. Bich. A constructive and elementary proof of Reny's theorem. Cahiers de la MSE 
b06001, Maison des Sciences Economiques, Universite Paris Pantheon-Sorbonne, Jan. 



2006. Available from http://ideas.repec.0rg/p/mse/wpsorb/bO6OOl.html 



K. Binmore. Playing for Real: A Text on Game Theory. Oxford University Press, Oxford, 
2007. 

K. Binmore. Fun and Games: A Text on Game Theory. D.C. Heath, 1991. 

C. Boutilier, R. I. Brafman, C. Domshlak, H. H. Hoos, and D. Poole. CP-nets: A tool 
for representing and reasoning with conditional ceteris paribus preference statements. 
J. Artif. Intell. Res. (J AIR), 21:135-191, 2004. 

F. Brandt, M. Brill, F. A. Fischer, and P. Harrenstein. On the complexity of iterated 
weak dominance in constant-sum games. In Proceedings of the 2nd Symposium on 
Algorithmic Game Theory, pages 287-298, 2009. 

A. Cournot. Recherches sur les Principes Mathematiques de la Theorie des Richesses. 
Hachette, 1838. Republished in English as Researches Into the Mathematical Principles 
of the Theory of Wealth. 

C. Daskalakis, P. W. Goldberg, and C. H. Papadimitriou. The complexity of computing 
a Nash equilibrium. Gommun. AGM, 52(2):89-97, 2009. 

G. Debreu. A social equilibrium existence theorem. Proceedings of the National Academy 
of Sciences, 38:886-893, 1952. 

M. Dufwenberg and M. Stegeman. Existence and uniqueness of maximal reductions under 
iterated strict dominance. Econometrica, 70(5):2007-2023, 2002. 



31 



K. Fan. Fixed point and minimax theorems in locally convex topological linear spaces. 
Proceedings of the National Academy of Sciences, 38:121-126, 1952. 

D. Fudenberg and J. Tirole. Game Theory. MIT Press, Cambridge, Massachusetts, 1991. 

D. Gale. Theory of n-person games with perfect information. Proceedings of the National 
Academy of Sciences of the United States of America, 39:496-501, 1953. 

I. Gilboa, E. Kalai, and E. Zemel. On the order of eliminating dominated strategies. 
Operation Research Letters, 9:85-89, 1990. 

I. L. Glicksberg. A further generalization of the Kakutani fixed point theorem, with 
application to Nash equilibrium points. Proceedings of the American Mathematical 
Society, 3:170-174, 1952. 

T. Groves. Incentives in teams. Econometrica, 41:617-631, 1973. 

H. Hotelling. Stability in competition. The Economic Journal, 39:41-57, 1929. 

N. Hyafil and C. Boutilier. Regret minimizing equilibria and mechanisms for games with 
strict type uncertainty. In Proceedings of the 20th Annual Conference on Uncertainty in 
Artificial Intelligence (UAI-O4), pages 268-27, Arlington, Virginia, 2004. AUAI Press. 

G. Jehle and P. Reny. Advanced Microeconomic Theory. Addison Wesley, Reading, Mas- 
sachusetts, second edition, 2000. 

S. Kakutani. A generalization of Brouwer's fixed point theorem. Duke Journal of Math- 
ematics, 8:457-459, 1941. 

M. Kearns, M. Liftman, and S. Singh. Graphical models for game theory. In Proceedings of 
the nth Conference in Uncertainty in Artificial Intelligence (UAI '01), pages 253-260. 
Morgan Kaufmann, 2001. 

D. E. Knuth, C. H. Papadimitriou, and J. N. Tsitsiklis. A note on strategy elimination 
in bimatrix games. Operations Research Letters, 7(3): 103-107, 1988. 

R. D. Luce and H. Raiffa. Cames and Decisions. John Wiley and Sons, New York, 1957. 

N. G. Mankiw. Principles of Economics. Harcourt College Publishers, Orlando, Florida, 
second edition, 2001. 

A. Mas-Collel, M. D. Whinston, and J. R. Green. Microeconomic Theory. Oxford Uni- 
versity Press, Oxford, 1995. 

H. Moulin. Game Theory for the Social Sciences. NYU Press, New York, second, revised 
edition, 1986. 

R. B. Myerson. Game Theory: Analysis of Conflict. Harvard University Press, Cambridge, 
Massachusetts, 1991. 



32 



J. F. Nash. Equilibrium points in n-person games. Proceedings of the National Academy 
of Sciences, USA, 36:48-49, 1950. 

J. F. Nash. Non-cooperative games. Annals of Mathematics, 54:286-295, 1951. 

N. Nisan, T. Roughgarden, E. Tardos, and V. J. Vazirani, editors. Algorithmic Game 
Theory. Cambridge University Press, 2007. 

M. J. Osborne. An Introduction to Game Theory. Oxford University Press, Oxford, 2005. 

M. J. Osborne and A. Rubinstein. A Gourse in Game Theory. The MIT Press, Cambridge, 
Massachusetts, 1994. 

D. G. Pearce. Rationahzable strategic behavior and the problem of perfection. Econo- 
metnca, 52(4):1029-1050, 1984. 

H. Peters. Game Theory: A Multi-Leveled Approach. Springer, Berlin, 2008. 

P. Reny. On the existence of pure and mixed strategy Nash equilibria in discontinuous 
games. Econometrica, 67(5): 1029-1056, 1999. 

K. Ritzberger. Foundations of Non-cooperative Game Theory. Oxford University Press, 
Oxford, 2002. 

R. T. Rockafellar. Gonvex Analysis. Princeton University Press, Princeton, 1996. 

S. L. Roux, P. Lescanne, and R. Vestergaard. Conversion/preference games. GoRR, 
abs/0811.0071, 2008. 

Y. Shoham and K. Leyton-Brown. Essentials of Game Theory: A Goncise, Multidisci- 
plinary Introduction. Morgan and Claypool Publishers, Princeton, 2008. 

M. Stegeman. Deleting strictly eliminating dominated strategies. Working Paper 1990/6, 
Department of Economics, University of North Carolina, 1990. 

The Economist 2007. Intelligent design. The Economist, October 18th, 2007, 2008. 

S. Tijs. Introduction to Game Theory. Hindustan Book Agency, Gurgaon, India, 2003. 

W. Vickrey. Counterspeculation, auctions, and competitive sealed tenders. Journal of 
Finance, 16:8-27, 1961. 

J. von Neumann. Zur theorie der gesellsschaftsspiele. Mathematische Annalen, 100:295- 
320, 1928. 

J. von Neumann and O. Morgenstern. Theory of Games and Economic Behavior. Prince- 
ton University Press, 1944. 



33 



